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DETAILED ACTION 
Response to Arguments 
The Examiner acknowledges the Applicants' amendments to the pending claims of the 
present application, including those to each of the independent claims. Regarding amended 
claim 1, and claims comprising similar subject matter, the Applicants assert that these claims are 
allowable, since the added limitation of a two dimensional sensor comprising an infrared 
illuminator was indicated by the Examiner as teaching over the prior art of record, namely over 
Korth (U.S. Patent No. 5,767,842 to Korth) and Rafii (U.S. Patent No. 6,614,422, to Rafii et al.). 
The Examiner maintains this assertion that Rafii and Korth do not teach a two dimensional 
sensor comprising an infrared illuminator. However, and as further shown below, the Examiner 
respectfully notes the Applicants' amendments to the claims comprise new matter, which as 
shown below, is not supported in the specification. Particularly, the specification of the present 
application does not explicitly describe a two dimensional sensor comprising an infrared 
illuminator, or a sensor that is physically and functionally distinct from the three-dimensional 
sensor of Rafii. Assuming however, for the sake of argument, that the specification of the 
present application in fact describes a two dimensional sensor comprising an infrared 
illuminator, the sensor being distinct from the three-dimensional sensor of Rafii (an idea with 
which the Examiner does not necessarily agree), the Examiner respectfully notes that such a two 
dimensional sensor comprising an infrared illuminator, implemented as claimed, is still taught by 
the prior art. For example, the U.S. Patent of Montellese (U.S. Patent No. 6,281,878) describes a 
two dimensional sensor comprising at least an infrared illuminator, which as shown below, 
senses user interaction with specific locations of a projected image of a keyboard. The 
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Applicants arguments with respect to the amended claims are thus made moot by the new 
grounds of rejection presented below. 

Regarding amended claims 33 and 80, the Applicants argue that Dunton (U.S. Patent No. 
6,690,357 to Dunton et al.) fails to teach the use of a single two dimensional camera comprising 
at least one infrared illuminator, as has been added to each of these claims. In response, the 
Examiner respectfully asserts that the above-noted U.S. Patent of Montellese describes a single 
two dimensional camera with an infrared illuminator, which as further shown below, may be 
implemented as claimed. The Applicants arguments with respect to the amended claims are thus 
made moot by the new grounds of rejection presented below. 

In reference to the previous Office Action, the Applicants assert that one ordinarily 
skilled in the art would not have been motivated to combine the image projection system 
described by Kaelin (U.S. Patent No. 6,435,682 to Kaelin et al.) with the devices described by 
Rafii and/or Dunton, as was alleged by the Examiner. This argument is rendered moot by the 
new grounds of rejection presented below. Regardless, the Examiner respectfully contends that 
one would have in fact been motivated to combine the image projection system of Kaelin with 
devices like those described by Rafii and/or Dunton (and/or Montellese), because such devices 
require an image projection system, and Dunton teaches an energy efficient image projection 
system. 

Further regarding the previous Office Action, the Applicants assert that one ordinarily 
skilled in the art would not have been motivated to combine the system and method of Nicolas 
(U.S. Patent No. 6,593,944) with that of Rafii and/or Carau, as was alleged by the Examiner. 
This argument is rendered moot by the new grounds of rejection presented below. Nevertheless, 
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the Examiner respectfully contends that one would have in fact been motivated to combine the 
system and method of Nicolas with that of Rafii and/or Carau (and/or Montellese), because Rafii 
and/or Carau (and/or Montellese) describe projecting a computer display image onto a surface, 
while Nicolas teaches that a commonly-used, and useful, computer display image is that of a 
webpage. 

The Applicants' arguments have thus been considered, but are moot in view of the 
following new grounds of rejection, which are required in response to the Applicants' 
amendments. 



Claim Rejections - 35 USC § 112 
The following is a quotation of the first paragraph of 35 U.S.C 112: 

The specification shall contain a written description of the invention, and of the manner and process of making 
and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the art to which it 
pertains, or with which it is most nearly connected, to make and use the same and shall set forth the best mode 
contemplated by the inventor of carrying out his invention. 

Independent claims 1, 33, 36, 41, 46, 49, 66, 71, 76, and 80, and the claims dependent 
therefrom, are rejected under 35 U.S.C. 112, first paragraph, as failing to comply with the written 
description requirement. The claims contains subject matter which was not described in the 
specification in such a way as to reasonably convey to one skilled in the relevant art that the 
inventors, at the time the application was filed, had possession of the claimed invention. In 
particular, each of these claims recite a "two dimensional sensor comprising at least one infrared 
illuminator." The specification of the present application, however, does not explicitly describe 
such a two dimensional sensor. The Applicants attempt to confirm that their invention comprises 
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a two dimensional sensor with an infrared illuminator, by presenting the following passages from 
the specification: 

Many kinds of sensors can be employed to detect pressing any of the 
"virtual" keys of the embodiments shown in Figs. 3A-3E. For example, as 
seen in Fig. 1, the sensor may be an optical sensor 40, such as an 
electronic camera, CCD or position sensing device (PSD), whose field of 
view encompasses the "virtual" keyboard or touch pad, etc. " (see 
paragraph 139 of the published application, inter-alia). 

In accordance with a preferred embodiment of the present invention, there 
is provided in operative association with at least one sensor 208, at least 
one infra-red illuminator 212 " (see paragraph 167 of the published 
application, inter-alia). 

Thus the Applicants assert that an electronic camera, CCD, or PSD, whose field of view 

encompasses a virtual keyboard, and which is in operative association with an infrared 

illuminator, is a two dimensional sensor comprising at least one infrared illuminator. The 

Examiner notes, however, that there is no explicit recitation in the specification that such a 

camera, CCD, or PSD specifically functions as a two dimensional sensor, and that in fact, such a 

camera, CCD, or PSD, having such a field of view, is not necessarily a two dimensional sensor. 

For example, the previously described U.S. Patent of Rafii similarly discloses what is understood 

to be a PSD, whose field of view encompasses a virtual keyboard, and which is in operative 

association with an infrared illuminator (for example, see column 10, line 26 - column 13, line 

60). Rafii nevertheless discloses that this PSD is implemented as a three dimensional sensor. 

Consequently, it is understood that the sensor described in the specification of the present 

application is not necessarily a two dimensional sensor as claimed, or that conversely, even if the 

sensor described in the specification is definable as a two dimensional sensor, then the sensor 
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described by Rafii may similarly be defined as a two dimensional sensor to read on the claimed 
invention, as it comprises the same physical and functional elements. 

Additionally, and particularly regarding claims 9, 10, and 52, inter alia, the specification 
of the present application doesn't explicitly describe a two dimensional sensor comprising at 
least one infrared illuminator, at least one visible light illuminator, and at least one visible 
radiation sensor, as is now expressed by these claims. 



Claim Rejections - 35 USC §102 
The following is a quotation of the appropriate paragraphs of 35 U.S. C. 102 that form the 
basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 35 1(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 

Claims 1, 7, 1 1, 12, 23-25, 32, 33, 49, 51-54, 57-60, 79, and 80 are rejected under 35 
U.S.C. 102(e) as being anticipated by U.S. Patent No. 6,281,878, which is attributed to 
Montellese (and hereafter referred to as "Monteilese"). In general, Montellese discusses devices 
for inputting data and commands into computer systems, such as small electronic devices, 
whereby the input devices are not susceptible to failure caused by particulate matter (see column 
1, lines 23-67). Montellese particularly proposes presenting the user with an image of an input 
device, and using a light sensor to detect the user's interaction with the image, in order to 
determine the user's intended input (for example, see column 2, lines 2-22). 
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Regarding claims 1 and 49, Montellese particularly teaches associating a small electronic 
device with a projector, which projects an image of an input device, such as a keyboard, onto an 
inert surface adjacent to the electronic device (see column 3, lines 22-61). The electronic device 
may also be associated with one or more two-dimensional electronic sensors, and an infrared 
illuminator, which are for sensing user indicator interaction with specific locations on the 
projected input device image (see column 3, line 61 - column 4, line 35). In addition, 
Montellese discloses that circuitry may be provided at the output of the sensors, to determine the 
user's intended input, which is provided to the small electronic device (see column 4, lines 35- 
52). It is understood that, if the input device is a keyboard, such input to the electronic device 
may comprise alpha-numeric information, and may be displayed on a display of the small 
electronic device. Consequently, a small electronic device, and its associated projector, sensors, 
and circuitry, operating as described by Montellese, is considered an apparatus like recited in 
claim 1, and is understood to teach a method like recited in claim 49. 

As per claims 7 and 51, Montellese discloses that the above-described illuminator, 
referred to as a "light source," may be operative to direct infrared radiation over the projected 
image of the input device, whereby the sensors may comprise an infrared sensor to sense the 
infrared radiation reflected, i.e. scattered, from the user indicator as it interacts with the projected 
image (see column 3, line 61 - column 4, line 35; and column 4, line 66 - column 5, line 22). 

As per claim 52, Montellese discloses that the above-described illuminator, referred to as 
a "light source," may be operative to also direct visible radiation over the projected image of the 
input device, whereby the sensors may comprise a sensor to sense the visible radiation reflected, 
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i.e. scattered, from the user indicator as it interacts with the projected image (see column 3, line 
61 - column 4, line 35; and column 4, line 66 - column 5, line 22). 

Concerning claims 1 1-12 and 53-54, Montellese discloses that the above-described user 
indicator, which interacts with the projected image of an input device, may be the user's finger, 
or may be a pencil or pen, i.e. a hand held stylus (see column 8, lines 39-45). 

Referring to claims 23-24 and 57-58, Montellese discloses that the above-described 
sensor may comprise an array of discrete sensing elements, each represented by a pixel (see 
column 5, lines 22-54). Such an array, which detects the user indicator as it is positioned 
approximate the sensor, is considered a "position sensitive detector" like recited in claim 24. In 
addition, Montellese discloses that such an array of sensing elements is of the type found in 
video cameras (see column 5, lines 22-28), which as known in the art, require a lens operative to 
image a region onto the array of sensing elements. It is consequently understood that the sensor 
of Montellese comprises at least one lens operative to image a region overlying the input device 
image onto a corresponding element in the array of discrete sensing elements. 

In regard to claims 25 and 59-60, Montellese discloses that the illuminator, referred to as 
a "light source," may be positioned to direct infrared and/or visible radiation at a plurality of 
levels above the image of the input device, and that a sensor may be operative to sense the 
infrared and/or visible light reflected, i.e. scattered, from the user indicator at a plurality of 
locations therealong (see column 3, lines 61-66; and column 5, line 65 - column 6, line 22). 
Montellese discloses that this may be done to detect the relative distance to the user indicator. 

Regarding claims 32-33 and 79-80, Montellese discloses that, in addition to a keyboard, 
the above-described projector may also project an image of a "pointer" input device, such as a 
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mouse (for example, see column 3, lines 27-49; and column 7, lines 8-13). Additionally, 
Montellese discloses that a single two dimensional sensor, comprising an infrared illuminator, 
may be used to sense user indicator interaction with specific locations on the image of the input 
device (for example, see column 5, line 65 - column 6, line 46). In such a case, the projector is 
considered to project an image of a keyboard and of mouse functionality onto a surface, whereby 
a single two dimensional sensor comprising an infrared illuminator senses user indicator 
interaction with specific locations of the image of mouse functionality. Montellese further 
discloses that circuitry may be provided at the output of the sensor, to determine the user's 
intended input, information of which is provided to the small electronic device (see column 4, 
lines 35-52). It is understood that, if the input device image is a mouse, such input to the 
electronic device may comprise cursor control information. Consequently, Montellese is 
understood to teach an apparatus like that recited in claims 32-33, and a method like that recited 
in claims 79-80. 



Claim Rejections - 35 USC §103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

Claims 2-6, 8-10, 13, 16-22, 26-29, 36, 41, 46, 50, 55-56, 61, 66, 71, and 76 are rejected 



under 35 U.S.C. 103(a) as being unpatentable over the U.S. Patent of Montellese, which is 
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described above, and also over U.S. Patent No. 6,614,422, which is attributed to Rafii et al (and 
which is hereafter referred to as "Rafii"), As described above, Montellese describes an apparatus 
and method like that of claims 1 and 49, respectively, for entering alpha-numeric information 
into a computer. Such an apparatus and method particularly entails implementing a projector for 
projecting an image of an input device, such as a keyboard, onto a surface; implementing a two 
dimensional sensor with an infrared illuminator for sensing user interaction with the image; and 
implementing information generation circuitry for a providing alpha-numeric output 
corresponding to the sensed user interaction, as is described above. Although Montellese 
discloses that such an apparatus and method may be implemented with an "electronic device, 
such as a portable computer or a personal organizer" (see column 2, lines 1-14, for example), 
Montellese fails to provide a comprehensive list of all the electronic devices in which the method 
and apparatus may be implemented. Montellese thus fails to explicitly disclose that the method 
and apparatus may be implemented with a wireless communicator, such as a cellular telephone, 
as is required in claims 2-4, 8-10, 26-28, 36-38, 41-43, 46-48, 50, 66-68, 71-73, and 76-78, or 
that the method and apparatus may be implemented with a personal digital assistant, as is 
required by claims 5-6. Similarly, Montellese fails to describe in specific detail the particulars of 
the projector or of the sensor, and thus fails to explicitly disclose the features of claims 13-22, 
29-31, and 61. 

Like Montellese, Rafii discusses methods and apparatuses for inputting data and 
commands into electronic devices, particularly by configuring such devices to project an image 
of a keyboard to be used to enter data into the device (see column 1, line 20 - column 2, line 20; 
and column 4, lines 7-33). The electronic device of Rafii thus comprises: a projector, like that 
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of Montellese, which is for projecting an image of at least part of a keyboard onto an inert 
surface in front of the electronic device (see column 4, lines 7-33; and column 10, lines 41-56); a 
sensor comprising an infrared illuminator, like that of Montellese, which is for sensing user 
interaction with specific locations of the keyboard image (for example, see column 4, lines 7-33; 
column 5, lines 39-53; column 9, lines 1 1-20; and column 10, lines 27-40); and alpha-numeric 
information generation circuitry at the output of the sensor, for providing alpha numeric output 
to a display (see column 6, lines 42-58; and column 8, lines 45-63). The illuminators and 
projectors of Rafii are considered analogous to the illuminators and projectors of Montellese, as 
they possess the same functionality. 

Consequently, it would have been obvious to one of ordinary skill in the art, having the 
teachings of Montellese and Rafii before him at the time the invention was made, to modify the 
methods and apparatuses taught by Montellese such that they may also be implemented with the 
electronic devices taught by Rafii. It would have been advantageous to one of ordinary skill to 
utilize such a combination, because as taught by Rafii and more fully shown below, there exists a 
plurality of devices which would benefit from input devices like those of Montellese. The 
methods and apparatuses of Montellese would thus be implemented on a larger range of devices, 
and would consequently be more utilized. Additionally, it would have been obvious to one of 
ordinary skill in the art, having the teachings of Montellese and Rafii before him at the time the 
invention was made, to modify the projectors and illuminators taught by Montellese such that 
they are implemented like those of Rafii, which are more fully described below. It would have 
been advantageous to one of ordinary skill to utilize such a combination, because Rafii presents 
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projectors and illuminators which may be effectively used with small electronic devices, whereas 
Montellese doesn't explicitly describe such projectors and illuminators. 

As per claims 2-4 and 50, Rafii discloses that the electronic device may be a wireless 
communicator, specifically a cellular telephone, which is operable to provide alpha-numeric 
output, such as e-mail, to a receiver (see column 8, lines 25-33; and column 8, lines 45-49). It is 
therefore understood that such a cellular telephone comprises a housing, in which is mounted a 
projector, a sensor system, and alpha-numeric generation circuitry in order to implement the 
above-described projected keyboard (for example, see column 4, lines 7-33; column 5, lines 39- 
53; and column 6, lines 42-58). 

In reference to claims 5 and 6, Rafii discloses that the above-described electronic device 
may be a personal digital assistant (PDA) (see column 8, lines 25-33; and column 8, lines 45-49). 
It is therefore understood that such a PDA comprises a housing, in which is mounted a projector, 
a sensor system, and alpha-numeric generation circuitry like described above (for example, see 
column 4, lines 7-33; column 5, lines 39-53; and column 6, lines 42-58). 

As per claim 8, Montellese discloses that the above-described illuminator, referred to as a 
"light source," may be operative to direct infrared radiation over the projected image of the input 
device, whereby the sensors may comprise an infrared sensor to sense the infrared radiation 
reflected, i.e. scattered, from the user indicator as it interacts with the projected image (see 
column 3, line 61 - column 4, line 35; and column 4, line 66 - column 5, line 22). 

As per claims 9-10, Montellese discloses that the above-described illuminator, referred to 
as a "light source," may be operative to also direct visible radiation over the projected image of 
the input device, whereby the sensors may comprise a sensor to sense the visible radiation 
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reflected, i.e. scattered, from the user indicator as it interacts with the projected image (see 
column 3, line 61 - column 4, line 35; and column 4, line 66 - column 5, line 22). 

As per claims 13, 16-18, 29, and 61, Rafii discloses that the projector used to project a 
keyboard image may comprise a point .light source, such as a laser, which illuminates a lens with 
a diffractive pattern delineating a keyboard etched on it (see column 10, lines 41-56). The lens 
thus serves as a mask defining the image of the keyboard, and therefore, Rafii teaches that the 
projector comprises a point light source illuminating a mask defining the image of the keyboard. 
By this reasoning, the projector is considered to comprise a diffractive optical element, 
specifically this lens having a diffractive pattern, which when illuminated produces the keyboard 
image on an inert surface. As shown in figure 1 A, when projected onto an inert surface, the 
keyboard appears non-distorted even though the projector does not directly (e.g. at a 90° angle) 
point to the surface. Such an angle of incident would normally create a distorted keyboard 
image. Thus it is understood that, to create such a non-distorted image given the angle of 
projection, the mask of Rafii is formed to define a distorted representation of the keyboard image 
in order to compensate for distortions in the projector. In addition, Montellese discloses that the 
projected keyboard image may dynamically change (for example, see column 3, lines 27-49). 
Consequently, it is understood that the mask of Rafii, as used to create such a dynamically 
changing image, is necessarily a dynamically changeable mask. 

With respect to claims 19-22 and 55-56, and particularly regarding the infrared and 
visible light illuminators recited in these claims, Rafii discloses that an illuminator, referred to as 
a "light source," may be implemented with either a laser or an LED (for example, see column 10, 
line 57 - column 11, line 2). Montellese similarly states that such a light source may be 
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implemented as a laser, and used to project infrared and/or visible light (see column 3, lines 61- 
66). Such a laser, implemented as an illuminator, is therefore considered a "point source," like 
that recited in the claimed invention. Rafii further teaches that the light from such a point source 
passes through a lens, like lens 288' in figure 3, and is radially directed to optically cover the 
projected keyboard (see column 13, lines 40-46; and note the light rays 140 in figures 1 A and 
IB, as are described in column 10, lines 27-34). Thus light emitted from the point light source is 
radially directed from the point source, and is projected onto a flat surface. Consequently, the 
infra-red and/or visible light illuminator taught by Rafii and Montellese is understood to 
comprise a "cylindrical reflecting element" like that recited in each of claims 19-22 and 55-56, 
which is for reflecting light from a point source and producing a generally flat, generally 
radially-directed light distribution. 

In regard to claims 26-28, Montellese discloses that the illuminator, referred to as a "light 
source," may be positioned to direct infrared and/or visible radiation at a plurality of levels above 
the image of the input device, and that a sensor may be operative to sense the infrared and/or 
visible light reflected, i.e. scattered, from the user indicator at a plurality of locations therealong 
(see column 3, lines 61-66; and column 5, line 65 - column 6, line 22). Montellese discloses that 
this may be done to detect the relative distance to the user indicator. 

Regarding claims 36 and 66, Rafii discloses that the above-described electronic device 
may be a "PDA, a wireless telephone, a laptop PC, a pen-based computer, or any other electronic 
system to which it is desired to input data" (see column 8, lines 29-33). It is consequently 
understood that this electronic device may be a wireless communicator providing wireless web 
browsing functionality, as is well-known in the art. The above-described teachings of 
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Montellese, which may be implemented on such an electronic device, particularly entails a 
projector, a two dimensional sensor, and alpha-numeric information generation circuitry, like 
that described in claim 36, and which projects an image of a keyboard onto a surface, senses user 
interaction with specific locations of the projected keyboard image, and generates an alpha- 
numeric output that may be useful in web browsing, like recited in claim 66. Such an electronic 
device, implementing the teachings of Montellese, is therefore considered a wireless system like 
that recited in claims 36, and is considered to teach a method like that recited in claim 66. 

Regarding claims 41 and 71, Rafii discloses that the above-described electronic device 
may be a "PDA, a wireless telephone, a laptop PC, a pen-based computer, or any other electronic 
system to which it is desired to input data" (see column 8, lines 29-33), and that the user may 
input e-mail into the computer system (see column 8, lines 45-49). It is consequently understood 
that this electronic device may be a wireless communicator providing email communication 
functionality, as is well known in the art. The above-described teachings of Montellese, which 
may be implemented on such a device, particularly entails a projector, a two-dimensional sensor, 
and alpha-numeric information generation circuitry, like that described in claim 41, and which 
projects an image of a keyboard onto a surface, senses user interaction with specific locations of 
the projected keyboard image, and generates an alpha-numeric output that may be useful in web 
browsing, like recited in claim 71 . Such a companion computer system, implementing the 
teachings of Montellese, is therefore considered a wireless system, like that recited in claim 41, 
and is considered to teach a method, like that recited in claim 71 . 

Regarding claims 46 and 76, Rafii discloses that the above-described electronic device 
may be a "PDA, a wireless telephone, a laptop PC, a pen-based computer, or any other electronic 
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system to which it is desired to input data" (see column 8, lines 29-33). It is consequently 
understood that this electronic device may be a wireless communicator providing mobile 
commerce communication functionality, as is well-known in the art. The above-described 
teachings of Montellese, which may be implemented on such a device, particularly entails a 
projector, a two dimensional sensor, and alpha-numeric information generation circuitry, like 
that described in claim 46, and which projects an image of a keyboard onto a surface, senses user 
interaction with specific locations of the projected keyboard image, and generates an alpha- 
numeric output that may be useful in web browsing, like recited in claim 76. Such an electronic 
device, implementing the teachings of Montellese, is therefore considered a wireless system like 
that recited in claim 46, and is considered to teach a method like that recited in claim 76. 

Claims 14-15, 30-31, and 62-63 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over the combination of Montellese and Rafii, which is described above, and also 
over U.S. Patent No. 6,435,682, which is attributed to Kaelin et al. (and hereafter referred to as 
"Kaelin"). As shown above, Montellese and Rafii presents a companion computer system, 
which like the apparatus recited in claim 1, comprises a projector for projecting an image of a 
keyboard onto an inert surface. Neither Rafii nor Montellese, however, go into great detail in 
describing this projector, only disclosing that it comprises a laser or other light source, and a lens 
upon which is etched a diffractive pattern to serve as a mask (for example, see column 10, lines 
41-56 of Rafii). Consequently, Montellese and Rafii do not explicitly disclose that the projector 
comprises a mirror directing light passing through the mask onto an inert surface, as is recited in 
claim 14, or that the projector comprises a lens directing light from the light source through the 
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mask, as is recited in claim 15. Rafii and Montellese also do not disclose that the projector 
comprises a spatial light modulator, like expressed in each of claims 31-31 and 62-63. 

Kaelin complements the teachings of Montellese and Rafii, detailing a projector system 
used to project images onto an inert surface (see column 1, lines 48-59). Specifically like 
Montellese and Rafii, Kaelin discloses that such an image projector system comprises a point 
light source, such as a laser, which illuminates a mask provided by a spatial light modulator in 
order to produce an image onto an inert surface (see column 2, lines 38-54; and column 3, line 38 
- column 4, line 3). Regarding the claimed invention, the image projector system of Kaelin 
comprises a mirror, to direct light passing through the mask onto the inert surface (see column 3, 
lines 30-37), and a lens, to direct light from the light source through the mask (see column 4, 
lines 27-39). 

It would have been obvious to one of ordinary skill in the art, having the teachings of 
Montellese, Rafii, and Kaelin before him at the time the invention was made, to modify the 
electronic device taught by Montellese and Rafii to include the projector system of Kaelin in 
order to project the keyboard image. It would have been advantageous to one of ordinary skill to 
utilize such a combination because the projector system of Kaelin requires less energy than 
conventional projectors, as is taught by Kaelin (for example, see column 5, lines 19-40). An 
energy efficient projector is beneficial in a small electronic device, such as that taught by Rafii, 
which normally comprises a limited energy source. Specifically regarding claims 31 and 63, 
Montellese discloses that the projected keyboard image may dynamically change (for example, 
see column 3, lines 27-49). Consequently, it is understood that the spatial light modulator of 
Kaelin, as used to create such a dynamically changing image, is necessarily a dynamic spatial 
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light modulator, like that described in claims 31 and 63, which is responsive to electrical input 
for producing a dynamic image. 

Claims 34, 37, 42, 47, 67, 72, and 77 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over the combination of Montellese and Rafii, which is described above, and also 
over U.S. Patent No. 6,266,048, which is attributed to Carau, Sr. (and which is hereafter referred 
to as "Carau"). As described above, particularly in the rejections for claims 36, 41, 46, 66, 71, 
and 76, Montellese and Rafii present an electrical device, which may be a wireless 
communicator providing web browsing functionality, email functionality, and/or mobile 
commerce communication functionality, and which comprises a projector for projecting an 
image of a keyboard onto a surface in front of the companion computer system. Neither 
Montellese nor Rafii, however, explicitly disclose that this projector also projects an image of a 
display onto the surface, as is recited in each of claims 34, 37, 42, 47, 67, 72, and 77. 

Like Montellese and Rafii, Carau presents a means for entering data into a computer 
system, whereby the computer system comprises a projector for projecting an image onto an 
inert surface, and comprises sensors to detect interaction with this image (see column 1, lines 12- 
36). Specifically regarding the claimed invention, Carau proposes projecting an image of a 
keyboard and a display (For example, see column 1, lines 56-65). 

It would have therefore been obvious to one of ordinary skill in the art, having the 
teachings of Montellese, Rafii, and Carau before him at the time the invention was made, to 
modify the electronic device taught by Montellese and Rafii to also project an image of a 
display, as is done by Carau. It would have been advantageous to one of ordinary skill to utilize 
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such a combination, because projecting a display allows the computer system to be smaller, as is 
taught by Carau (see column 1, lines 12-36). Regarding the claimed invention, it is understood 
that this projected display may comprise images produced during web browsing, messages 
produced during email communication, or images produced during mobile commerce 
communication, which are common in displays of companion computer systems like those 
taught by Rafii and Montellese. 

Claims 38, 43, 48, 68, 73, and 78 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over the combination of Montellese, Rafii and Carau, which is described above, and 
also over U.S. Patent No. 6,593,944, which is attributed to Nicolas et al. (and hereafter referred 
to as "Nicolas"). Regarding claims 38 and 68, the combination of Montellese, Rafii and Carau 
presents an electronic device, which like the apparatus and method expressed in claims 37 and 
67, respectively, comprises a projector for projecting an image of a keyboard and a display onto 
a surface, and a sensor for sensing user interaction with the projected keyboard. It is understood 
that the projected display may particularly comprise images produced during web browsing, a 
conventional function of such companion computer systems. Neither Montellese, Rafii, nor 
Carau, however, explicitly disclose that the sensor senses user interaction with specific locations 
on this projected display, and that web browsing input circuitry at the output of the sensor 
provides a web browsing output based on user actuation of locations on the projected display, as 
is expressed in claims 38 and 68. 

Like Montellese, Rafii, and Carau, Nicolas discusses small electronic devices, such as 
PDAs and cellular phones, and regarding the claimed invention, Nicolas describes the use of 
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such small electronic devices to display and browse web pages (see column 1, line 33 - column 
2, line 14). Nicolas particularly teaches that an electronic device may display a web link, 
whereby in response to detecting user actuation of this web link with a stylus, a web browsing 
output, specifically a web page, is provided (see column 1 1, lines 52-67). 

Therefore, it would have been obvious to one of ordinary skill in the art, having the 
teachings of Montellese, Rafii, Carau, and Nicolas before him at the time the invention was 
made, to modify the electronic device taught by Montellese, Rafii, and Carau, such that the 
sensors also detect user interaction with the display, as is done by Nicolas. It would have been 
advantageous to one of ordinary skill to utilize such a combination because, as is demonstrated 
by Nicolas, the ability to directly interact with the display is useful in particular applications, 
such as web browsing. 

In reference to claims 43, 48, 73, and 78, the above-described electronic device of 
Montellese, Rafii, Carau, and Nicolas comprises a projector to project a display, and circuitry to 
output data in response to user actuation of specific locations on the projected display. It is 
understood that the projected display may comprise images produced during email 
communication or mobile commerce communication, which are common functions of such 
electronic devices. Consequently, it is further understood that the sensor of the electronic device 
senses user interaction with specific locations on the projected display, and that the circuitry at 
the output of this sensor may provide a mobile commerce or email communication output based 
on detected user interaction with specific locations of the projected display. 
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Conclusion 

Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Blaine Basom whose telephone number is (571) 272-4044. The 
examiner can normally be reached on Monday through Friday, from 8:30am to 5:30 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John Cabeca can be reached on (571) 272-4048. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 



Application/Control Number: 09/866,859 Page 22 

Art Unit: 2173 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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